Tootfinder

OpenAI's new ChatGPT voice assistant jokes, chides, apologizes, pretends to blush, and deals with interruptions, aided by building GPT-4o as a single model (Ina Fried/Axios)
https://www.axios.com/2024/05/14/openai-chatgpt-4o-chatbot-her

ChatGPT's new voice welcomes interruptions
The new ChatGPT-4o spent 15 minutes of live-streamed demo time responding to

Input 📣⁠Lang⁠📣

DAVx⁵

at.bitfire.davdroid
https://github.com/bitfireat/davx5-ose
dev.corruptedark.diditakemymeds
https://github.com/corruptedark/did-i-take-my-meds
org.futo.voiceinput
https://app.futo.org/fdroid/repo?appId=org.futo.voiceinput
org.dslul.openboard.inputmethod.latin
https://github.com/dslul/openboard
mf.asciitext.lite
https://f-droid.org/packages/mf.asciitext.lite
dev.obfusk.jiten
https://github.com/obfusk/jiten
fe.linksheet.compat
https://github.com/1fexd/linksheetcompat
fe.linksheet
https://github.com/1fexd/linksheet
com.zell_mbc.medilog
https://codeberg.org/toz/medilog
ru.application.homemedkit
https://github.com/pewaru-333/HomeMedkit-App
ca.rmen.android.poetassistant
https://github.com/caarmen/poet-assistant
de.reimardoeffinger.quickdic
https://f-droid.org/packages/de.reimardoeffinger.quickdic
at.jclehner.rxdroid
https://github.com/jclehner/rxdroid
com.github.tmo1.sms_ie
https://github.com/tmo1/sms-ie
xyz.tcreopargh.textconverter
https://github.com/TCreopargh/Text-Converter-Android
com.bnyro.translate
https://github.com/you-apps/TranslateYou
juloo.keyboard2
https://github.com/Julow/Unexpected-Keyboard
jp.ddo.hotmist.unicodepad
https://github.com/Ryosuke839/UnicodePad
com.waist.line
https://f-droid.org/packages/com.waist.line

GazePointAR: A Context-Aware Multimodal Voice Assistant for Pronoun Disambiguation in Wearable Augmented Reality
Jaewook Lee, Jun Wang, Elizabeth Brown, Liam Chu, Sebastian S. Rodriguez, Jon E. Froehlich
https://arxiv.org/abs/2404.08213

GazePointAR: A Context-Aware Multimodal Voice Assistant for Pronoun Disambiguation in Wearable Augmented Reality
Voice assistants (VAs) like Siri and Alexa are transforming human-computer interaction; however, they lack awareness of users' spatiotemporal context, resulting in limited performance and unnatural dialogue. We introduce GazePointAR, a fully-functional context-aware VA for wearable augmented reality that leverages eye gaze, pointing gestures, and conversation history to disambiguate speech queries. With GazePointAR, users can ask "what's over there?" or "how do I solve this math problem?" simpl…

I have a trip to Japan coming up and if ChatGPT's voice assistant translation capabilities are released by then, well, I'm excited.

This https://arxiv.org/abs/2306.17477 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csSD_…

Beyond-Voice: Towards Continuous 3D Hand Pose Tracking on Commercial Home Assistant Devices
The surging popularity of home assistants and their voice user interface (VUI) have made them an ideal central control hub for smart home devices. However, current form factors heavily rely on VUI, which poses accessibility and usability issues; some latest ones are equipped with additional cameras and displays, which are costly and raise privacy concerns. These concerns jointly motivate Beyond-Voice, a novel high-fidelity acoustic sensing system that allows commodity home assistant devices to …

Developer email: Amazon will no longer pay developers to create Alexa apps, and stops offering free AWS credits; developers can still monetize apps via IAPs (Matt Day/Bloomberg)
https://www.bloomberg.com/news/articles/20…

Amazon to Stop Paying Developers to Create Apps For Alexa
Amazon.com Inc. will no longer pay developers to create applications for Alexa, scrapping a key element of the company’s effort to build a flourishing app store for its voice-activated digital assistant.

Technology-assisted Journal Writing for Improving Student Mental Wellbeing: Humanoid Robot vs. Voice Assistant
Batuhan Sayis, Hatice Gunes
https://arxiv.org/abs/2403.05083

Technology-assisted Journal Writing for Improving Student Mental Wellbeing: Humanoid Robot vs. Voice Assistant
Conversational agents have a potential in improving student mental wellbeing while assisting them in self-disclosure activities such as journalling. Their embodiment might have an effect on what students disclose, and how they disclose this, and students overall adherence to the disclosure activity. However, the effect of embodiment in the context of agent assisted journal writing has not been studied. Therefore, this study aims to investigate the viability of using social robots (SR) and voice…

Apple researchers detail an AI system that can resolve ambiguous references to on-screen entities, in some cases better than GPT-4 can, and can run "on-device" (Michael Nuñez/VentureBeat)
https://venturebeat.com/ai/apple-resea

Apple researchers develop AI that can ‘see’ and understand screen context
Apple researchers develop AI system that understands screen references and context, enabling more natural voice assistant interactions.

This https://arxiv.org/abs/2402.11125 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csRO_…

See Spot Guide: Accessible Interfaces for an Assistive Quadruped Robot
While there is no replacement for the learned expertise, devotion, and social benefits of a guide dog, there are cases in which a robot navigation assistant could be helpful for individuals with blindness or low vision (BLV). This study investigated the potential for an industrial agile robot to perform guided navigation tasks. We developed two interface prototypes that allowed for spatial information between a human-robot pair: a voice-based app and a flexible, responsive handle. The participa…

Beyond Voice Assistants: Exploring Advantages and Risks of an In-Car Social Robot in Real Driving Scenarios
Yuanchao Li, Lachlan Urquhart, Nihan Karatas, Shun Shao, Hiroshi Ishiguro, Xun Shen
https://arxiv.org/abs/2402.11853

Beyond Voice Assistants: Exploring Advantages and Risks of an In-Car Social Robot in Real Driving Scenarios
In-car Voice Assistants (VAs) play an increasingly critical role in automotive user interface design. However, existing VAs primarily perform simple 'query-answer' tasks, limiting their ability to sustain drivers' long-term attention. In this study, we investigate the effectiveness of an in-car Robot Assistant (RA) that offers functionalities beyond voice interaction. We aim to answer the question: How does the presence of a social robot impact user experience in real driving scenarios? Our stu…

This https://arxiv.org/abs/2402.11853 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csHC_…

Beyond Voice Assistants: Exploring Advantages and Risks of an In-Car Social Robot in Real Driving Scenarios
In-car Voice Assistants (VAs) play an increasingly critical role in automotive user interface design. However, existing VAs primarily perform simple 'query-answer' tasks, limiting their ability to sustain drivers' long-term attention. In this study, we investigate the effectiveness of an in-car Robot Assistant (RA) that offers functionalities beyond voice interaction. We aim to answer the question: How does the presence of a social robot impact user experience in real driving scenarios? Our stu…

See Spot Guide: Accessible Interfaces for an Assistive Quadruped Robot
Rayna Hata, Narit Trikasemsak, Andrea Giudice, Stacy A. Doore
https://arxiv.org/abs/2402.11125

See Spot Guide: Accessible Interfaces for an Assistive Quadruped Robot
While there is no replacement for the learned expertise, devotion, and social benefits of a guide dog, there are cases in which a robot navigation assistant could be helpful for individuals with blindness or low vision (BLV). This study investigated the potential for an industrial agile robot to perform guided navigation tasks. We developed two interface prototypes that allowed for spatial information between a human-robot pair: a voice-based app and a flexible, responsive handle. The participa…